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IN THE CLAIMS : 
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image data, wherein said control means permits the print of an image which corresponds to 
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IMAGE PROCESSING APPARATUS, 
DATA PROCESSING METHOD, AND STORAGE MEDIUM 

BACKGROUND OF THE INVENTION 
Field Of tHe Invention 

The present: invenr.xon relates to an image 
processing apparatus, a data processing method, and a 
storage medium. 
Related Background Art 

There has been no conventional means to prevent 
production given in digital information from being 
copied illegally or no ni<^an$ established to essentially 
protect production. For example, a converit i onal image 
processing system which comprises a print controller 
which receives image data coded in a page-description 
language from a host computer and converts the data 
into raster image data and then sends it to an image 
forming device an<3 the image forming device which formy 
images based on the image data thus sent from the print 
controller has no means to recognize image data sent 
from the print controller even if it is production, 
thus being unable to prevent such production from being 
copied illegally. 

In the recent background that has strengthened 
legal protection of production given in digital 
information^ a technological method is required to 
legally prevent illegal copying of production by use of 
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a copying machine^ pi'inter, tftc 

On -tlie other hand, however^ "the copyz-ighl of sonie 
produc-tion can be bought from the author to output it 
with permission from him, 
5 Such production needs to be released from its 

prohibition state of the image data protected (i,e,, 
copy-protected) based on production inf orma t:lon, which 
has not been taken into account. Therefore, there have 
been such cases that even with permission obtained from 
10 the author, his production cannot be output. 

Also^ there has not: been discussed fully about 
technologies to provide other pieces of production 
relating to one production baaed on its information 
obtained . 

15 

SUMiyJARY OF THE INVENTION 

In view of the above, it is an object of the 
present invention to provide an image processing 
device, a data processing method, and a storage medium 
20 that have solved the above-mentioned problems - 

Another object of the present invont-ion is to 
provide such an image processing device that can 
appropriately process production and a method for 
processing data as well as a storage medium for this 

25 purpose - 

An appropriate example of the present invention is 
written in a claim 1 . 



S-till ano-ther object of the present invention is 
to provide such an image processing apparatus that has 
a novel function and e data processing method a^ well ^ 
as a storage medium for this puxpose. 

The other objects and features of the present 
invention will be apparent from the following 
description on the embodiment with reference to Uhe 
appended drawings . 

BRIEF DESCIPTION OF THE DRAWINGS 

Fig, 1 shows outer appearances of a configuration 

of an image processing system according to one 

embodiment of the present inventions- 
Fig. 2 is a cross-sectiOTial view o£ a 

configuration of an image processing device shown in 

Fig. 1; 

Fig. 3 is a block diagram of a configuration of an 
image processing unit shown in Fig* 2; 

Fig- 4 is a property graph of one example of a 
gradation correction proper-ty of an input/output signal 
at a reader gradation correcting circuit shown in Fig, 
3? 

Fig. 5 is a property graph of one example of an 
input/output signal at an engine gradation correcting 
circuit; 

Fig, 6 is a flowchart illustrating one example of 
a first image data processing procedure; 



Figs. 7 A, 7B, 7C, 7D and 7F show examples of a 
mark and a characteir st.ring which, indioatifii being 
product;ion ; 

Figs- SA and SB show examples of a warning screen 

displayed at: a display portion of an operat.ing uni i. a± 

a host computer or an image processing device; 

Fig, 9 is a flowchart illustrating one example of 

a second image data processing procedure; 

Fig. 10 is a flowchart illustrating one extjmple 

of a third image data processing procedures- 
Fig. 11 is a flowchart illustrating one example of 

a fourth image data px^ocessing procedure; 

Fig. 12 is a flowchart illustrating image data 

processing at a printer controller according to a fifth 

embodiment ; 

Figs. 13A and 13B respectively show examples of a 
password input screen and a password-mismatch warning 
screen which are displayed on the host computer in 
image data processing ; 

Figs, 14E, 14C, 14D and 14E illustrate 

examples of a mark and a character string which 
indicate being production; 

Fig. 15 shows an configuration of an image forming 
system according to a sixth embodiment; 

Fig_ 16 is a flowchart lllusstratlng image datea. 
processing at a printer controller in the image forming 
system shown in Fig , 6 ; 



Fig. 17 is a flowchart illustra-ting image data 
processing at the px-intor controller in a seventh 
embodiment ; 

Fig, 18 shows a warning screen for confirming 
acceptance of accounting of production in the image 
data processing according to the seventh embodimonv. of 
Fig- 7; 

Figs. i9A and 19B respectively screen for 
displaying production-use information for confirming 
accounting information o£ production in the image data 
processing according to the seventh embodiment of Fig. 
7; 

Fig, 20 shows a configuration of an eighth 
embodiment of the present invention; 

Fig- 21 is a flowchart for the eighth embodimeiit ; 

Fig. 22 shows a display example of the eighth 
embodiment ; and 

Fig- 23 is another display example of the eighth 
embodiment . 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
First embodiment 

Fig. 1 shows outer appearances of a configuration 
of an image prooessing system according to one 
embodiment a€ the pr^esent invention , 

In the figure, a reference numeral 101 indicates 
host computer and a numeral 102 indicates a print 
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controller cont.r-oller ) . A numeral 103 indicates 

an image forming device (i-e-, printer), which color - 
copies a manuscripl. mounted on a manuscript £>tation and 
also outputs images sent from a host computer 101 via 
5 the print controller- 

The host computer 101 converts image da La into 
information coded in the page description languc^gG 
( PDL) and then sends it via a connecting cable to the 
print controller 102, 
10 The print controller 102 then translates PDL dcita 

sent from the host computer 101 and executes raster 
image processing to oonver-t the PDL data into raster 
image data, which is subsequently sent via thti 
connecting cable to an image forming device 103 to 
15 provide the corresponding images. 

Fig. 2 is a cross-sectional view of a 
configuration of the image processing device 103 shown 
in Fig- 1^ which comprises: a digital-color image 
reader unit (hereafter called reader unit) 201 at its 
20 top; a printer engine unit (hereinafter called engine 

unit) 202; and an image processing unit 203 .set. between 
the reader unit 201 and the engine unit 202* 

The following will describe the configuration of 
the image forming device 103 and the operations of 
25 copying mamiscript images? as a copying machine. 

In the figure, when a manuscript is mounted on ci 
iiianuscript sLaLion glas.s surface 31 and a copy star-t; i-S* 



execuired, illuminaliion is reciprocated in a 
pi^ede-termined direction to collect a light T-eflected on 
the manuscript at a tull-oolor sensoT^ ^-^4 rourmed 
integrally with an RGB three-color resolving filter 
through a lens 33 via mix-r-oi's 32a ^ 32b, and 32c, to 
obtain a color-resolving image analog signal. The 
color-resolving image analog signal is digitized at an 
amplifier circuit (not shown) and pi^ocessed at an image 
proc<sssing unit and then sent to the engine unit 202. 
A numeral 205 indicates an operating unit, which is 
provided with a display unit and various keys (neither 
of which is shown), to give various settings and 
instructions to the image forming device 103, 

At the engine unit 202, an image-carrying 
photosensitive drum 1 is carried rotational} y in an 
arrovj direction, around which are arranged a pre- 
exposure lamp 11, a corona charger 2, a laser-exposure 
optical system 3, a potential sensor 12^ four 
developers (yellow developer 4y, cyan developer- 40, 
magenta developer 4M, black developer 4K ) , a d^rum- 
mounted light-quantity detecting sensor 13, a transfer 
device 5 ^ and a cleaner 6 . 

In the laser-exposure optical system, an image 
signal from the reader unit 201 is converted at a 
lase^r-output unit (not sl^iown ) i nt:o a J-ighr si'gnai, 
that thus converted laser light is reflected on the 
polygonal mirror 3a and passes through the lens 3b and 
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the mirror 3c to be pro.ieoted onto the surface of the. 
photosensitive drum 1 . 

When an image is formed by the engine unit 202, 
the photosensitive drum is rotated in the arrow 
5 direction to discharge the drum surface with the pre- 
e>:posure lamp ll and then charge it uniformly witi-i tiac-- 
corona charger 2, in order to subsequently illumi neti tkj 
a light image E for each resolving color so cis to form 
a latent image on th& photosensitive drum 1 - 
10 Next, the predetermined developers (4Y, 4M, 4C, 

and 4K) are operated to develop the latent imago on the 
photosensitive drum 1, thus; forming a toner image 
having resin as its base, on the photosens.i ti ve dr-um 1. 
These developers (4Y, 4M, 4C, and 4K ) aro e.ach caused 
15 by eccentric cams 24Y, 24C, 24M, and 24K respectively 
to approach the photosensitive drum 1 for eacln 
resolving color . 

Next, the toner image developed on the 
photosensitive drum 1 passes through a recording- 
20 material cassette 7a and an intermediate tray 22 or 
recording-material tx^ays 7b and 7c and then 
detection/conveying sysliems bQ-52 and a transfer device 
5 and then is transferred onto a recording material 7 
(7a, 7b, and 7c) supplied at a position opposing l:he 
25 photosensitive dx'um 1 . 

In this embodiment also, the transfer device 5 
comprises a branyfoi^ drum 5a given ay a 



recording-maiierial holding means, a transfex" chcirger- 
SiD, a suckiiig roller 5g opposing an absorbing charger- 
5c for electro-statistically sucking the recording 
material 7, an internal charger an outside charger 

5C and a oam-Iollower 5i, in such a conf icjura i.ion thyt 
a record ing-nia-beriai carrying sheet 5f made of a 
dielectric is extended and int^igx^ally formed in a 
peripheral opening region of the transfer drum 5a 
axially support:ed so as to be driven rotational ly , 'Phti 
recording-material carrying sheet 5f comes in a 
dielectric sheet (hereinafter called transfer sheet) 
made of a polycarbonate film etc. 

As the transfer drum 5a is rotated^ the toner 
image on the photosensitive drum 1 is transferred onto 
the recording material 7 carried on the recoxxling- 
material carrying sheet 5f, 

Thus ^ on the recording material 7 which -i y yucJ<cd 
and conveyed by the recording-material carrying sheet 
5f , a desired color image is transferred to form a 
full -co lor image - 

In the case o£ forming a full-color image, the 
recording material 7 on which a four-color tonei" image 
has transferred is separated from the transler drum 5a 
by a separation claw 8a and then from the transfer 
sheer 5f by as separaring-and-l.i rting roller ab and a 
separat.-ing charger 5h and then ejected from a tr-ay ICD 
via a thermal roller fixing devicc^i ( hex^c^irinf ter Ocillcid 
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fiKing device). 

Also, -the photosensitive drum 1 af-bei" comple.tion 
o£ transfer is nleaned of residual surface ton^r with 
the cleaner 6 -and then sent Lo uhe image for-nilnq <;i:ep 
again- 

At the fixing device. 9^ a reference numex'cil ^^q 
indicates a conveyor belt, which conveys to the fixing 
device 9 the recording material 7 separated from the 
transfer device 5- Mumerais 9e and 9f indicate 
heaters^ which heat an upper roller- 9a and an lower 
roller 9b. 

When an image is formed on thci surface of a 
recording material 7^ on the other hand, the rocorciing 
material 7 is provided with an image formed on it-s ono 
surface is ejected from the fixing device 9 and, 
immediately after that, a conveying-path switching 
guide 29 is driven to cause the recor^din.g material 7 to 
pass through a conveying path 20 and be introduced once 
onto a reversing path 2la^ and when a reversing rol le.r 
21b rotates in a reverse dirc^ction, the recording 
material 7 is taken out starting from its rear end Lhu?; 
taken in last, in a direction opposite to that It has 
been taken in. Then, l.he above-mentioned image fox-mi nc.j 
step is executed again, -to form an image on the othar 
Surface , 

Also, to prevent the scattering and sticking of a 
fine particle, on the rcicording-material carrying sheet 



5£ of the transfer drum n and the sticking of ui 1 ori 
the jrecoiraing material 7, they are cleaned by using 3 
fur brush 14 and a backup fur brusii opposing each other 
via the recording-material carrying sheet 5f , an oil- 
cleaning roller 16 and an oil-cleaning backup bru^i;h 1.7 
opposing each other via the recording-material carrying 
sheet 5±r or a polishing roller 18 and a polishing 
roller backup brush 19 opposii^g each other via the 
recording-material carrying sheet 5f . Such cleaning i-s 
carried out before or after image formation and every 
time when Jamming (of paper) occurred. Also, in the 
configuration of this embodiment, Uhe eccentric cam 25 
is operated at desired timing to wox^k tihe cam follower 
51 formed integrally V7ith the transfer drum Sa, thus 
making it possible to arbitrarily set a gap between the 
recording-material carrying sheet 5f and the 
photosensi tive drum 1. For example, at the standby or 
power-off, the gap is enlarged between the transfer 
drum 5a and the photosensitive drum 1. 

Fig* 3 is a block diagram of a configuration of 
the image processing unit shown in Fig. 2. 

In the figure, a reference numeral 301 indicates a 
CCD reading unit, which comprises an amplifier for 
amplifying each of analog RGB signals i.npul from the 
CCD34 shown in Fig- 2, an A/D convortcx- for c::OnverLing 
the analog RGB signals into for example 8-bit digital 
signals, and a shading cox-recting circuit for 
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correcting known shading, etc, thus outputting digital 
RGB signals of a manuscript image. 

A numeral 302 indicates a shift memory, which 
corrects a shift: for example between colors and picti.irc 
5 elements of -an RGB image signal input from the CCD 

reaching unit in response to a shift-quantity control 
Signal sent from the reader controlle>r 120. A numer-sl 
303 indicates a complementary- col or converting circuit, 
which converts an RGB image signal input from the shift 
10 memory 302 into an MCY image signal, A numeral 304 

indicates a black-extracting circuit, which responds to 
a black-eKtracting signal input from the reader 
controller 120, to extract a black region of an image 
from MCY (magenta, cyan, and yellow) image f^-ignals 
15 input from the complementary-color convex-ting circuit 

303 and then output a K (black) image signal for thus 
extracted black region . 

A numeral 305 indicates a UCR circuit:, which 
responds to the K image signal input fi^om the black- 
20 extracting circuit 304 and the UCR-quantity contirol 

Signal input from the reader contT-oller 120, to execute, 
under-color removing (UCR) processing on the MCY image 
signal input from Lhe complementary-color converting 
circuit 303, That is, l.he black-extracting circuit 304 
25 and the UCR c::i2rc:iiit 305 do not superpose- thi3?5 cixtracLed 

black region onto 3-color (M, and Y) toner buL 

replace it with K toner, thus improving the color 



reproduction performance . 

The K image signal output from the black- 
extracting circuit 304 is given a?>: K = A x min(C2, Y2, 
M2) . 

Wh^re^ A indicates a black-extracting coefficient 
and C2, YZ, enC M2 respectively indicate M, C, axid Y 
image signals output from the complementary-color 
converting circuit 303. The black-extracting 
coef f iciex-xt A 1$ d(Stcrmined by the black-extracting 
quantity control signel specified by the reader 
controller 120 , 

MCY image signals (Ml, CI, Yl ) output fx-om the UCR 
circuit 305 are delerniined as: Ml = Bl x (m2 - Dl x k), 
Cl = B2 X (C2 - D2 X K) , and Yl = B2 x ( Y2 - x K ) . 

Note here that M2, C2, and Y2 represent MCY 
signals output from the complementary-color conve-rti ncj 
circuit 303, and coefficients Bl , B2, B3 , Dl , 132, and 
D3^ are determined by the UCR-quantity control signal 
£rom the reader controller 120. 

Next, a numeral 306 indicates a masking circuit, 
which executes masking processing on MCY image signals 
input from the UCR circuit 30h in response to a 
masking-coef ficient control signal input from the 
reader controller 120, to remove l:urbidity of the toner 
used and correcL the RGB filtcjx- propcx-tioa of the CCn _ 
The MCV image signals (MO, CO, YO ) output Irom the 
masking circuit 306 are expressed as follows: 
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(Matrix 1) 



MO 




CO 




[yOi 





all 312 ai3^ 
a21 &22 a23 
,^31 a32 a33 



Ml 
CI 



\ 



wl^ere all t-lirough a33 Indicatie masking coefficients, 
which S-r-Gi dG-tO-rminetl by the masking-coef f icient: contx-ol 
5 signal specified by the reader controller 120; and Ml, 
CI, and Yl indicate MCY image signals output from the 
UCR circuit 305. 

A numeral 307 indicates a selector^ which selects 
a one-color image signal, and outputs an image s-ignal 

10 VI, of the C, Y, and K image signals input from the 
masking circuit 306 and the black-extracting circuit 
304 in response to the color- selecting signal input 
from the reader controller to a selecting terminal S 
and the Y, and K image signals input from the 

15 print controller 102 via an external interface (1/F) 
circuit 308 . 

A numeral 309 indicates a reader-gradation 
correcting circuit, which executes such gx^adation 
correction as shown in Fig, 4 on an image signal VI 

20 input from the selector 307 and then outpul.s an imago, 
signal V2 . For e^campie, the readox^-gradat d ori 
correcting circuit 309 executes color-densi Ly 
corzrection using either one of the conversion 
properties a through e (described later wit.h refex-ence 

25 to Fig, 4) which are selected based on a 
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giradation-correcti on seleoting signal specified by the 
reader controller 120, The set-l-.ing by l;hif=- re_ade_r- 
gradation correcting circuit 309 is detennj ned by the 
s&tting of image color-density by the copying-machine 
5 operating unit- 

A numeral 310 indicates e gradation correcting 
circuity which corrects an image signal by selecting 
either one of the gamma -conversion properties M, C, Y, 
and K (described later with reference to Fig. 5) 

10 according to an engine-color selecting signal input 

from an engine controller 110, to linearize the output 
property of an engine unit 202 for each col or- _ 

A numeral 311 indicates a laser driver ^ which irs 
included in the laser-exposure optical system 3 . The 

15 laser driver 311 modulation-drives a semiconductor 

laser based on an image signal V3 input from the 
engine-gradation correcting circuit 310, to fox-m a 
latent image on the photosensitive drum 1 . 

Also^ the image processing unit 203 comprises a 

20 CPU, ROMs, and RAMs (none of which is shown), to cause 

the CPU to govern the entire image processing uni {. 203 
based on a program stored in the ROMs. The kams hcrir-e 
are used as a work region for the CPU, 

In the print controller 102, a CPU indicated by a 

25 niamG>3rEal 104 gove^rns the eiitire print coiitroller 102 

based on a program stored in a memory 106 or a storage 
medium (not shown). A numeral 105 Indicates a 
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detecting circuit:, whicl^ c.xoculcs copyrigh1:-inf oi-mation 
det:ect:ing processing describe later and outputs an 
image-output prohibition signal- Als',a , th.e memoi-y 106 
is used as a work region for the CPU 104 and as a 
5 storage region for image data transferred by the host 
computer 101 and the image-output prohibition .signal 
output from the detecting circuit 105. 

The following will describe the operations of the 
system including the print controller 102, 

10 Expansion of PDL dats refers to an oper-ation of 

expanding PDL data to a full -color image by use of the 
host computer 101 and than wcitirig it into the memory 
105 of the print controller 102. This full-coloi" image 
is stored, in agreement with the image forming device 

15 103, into the memory 105 as image data which is coioi:- 
resolved into foui^ coloi-s of M, C, Y, and K. Klotei ht^r-o 
that this memox-y 106 stores also the image-output 
prohibition signal detected at the detecting circuit 
105 which executes copyright-information detecting 

20 processing which is described later. The image-output 
prohibition signal is i-oad out together with image data 
resolved into four colors from the memoi-y 106 and yont 
to the image forming device 103, 

If, in this case, the image-output prohibition 

25 Kignp^l ±s^ not generated, image data sent to Lhe image 

forming device is printed out, during which a full- 
color image stored in the memory lOfi ±b r-c^.ad out in 
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syncl^ronization wit:h t:he rota-bion of the photosensitive 
diium 1 and then se.nt to the laser dT--iver 311. These 
oper-ations are controlled by the CPU 104 of Lhe prlnl. 
controller 102 . 

Fig, 4 shows one example of -the gr&dation- 
correction property of an i nput/ou l:put signal at the 
reader-gradation correcting circuit. 309, in which the 
horizontal axis corresponds to the input signal (input 
data) and the vertical axis, to the output signal 
( output: dat:a ) . 

Fig. 5 shows one example of the gradai.ion- 
correcting property of an input /output signal at the 
engine-gradation correcting circxiit 310, in which tVie 
horizontal axis coi^rr^isponds to the input signal (input 
data) and the vertical axis, to the output signal 
( output data ) , 

The following will describe the operation of 
processing PDL data at the. print controller 102, 

Fig, 6 is a flowchart illustrating one examples of 
the first image-data processing procedure in an image 
processing system according to this embodiintiiit , whicVi 
corresponds to the PDL data processing at t>ie print, 
controller 102. Numerals 1 to 9 indicate the step 
numbers - 

First, the system receives one unit of PDT. data 
from the host computer 101 (step 1), This one unit may 
be a few byte, one page, or one line as far as it fits 
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to the processing. Then, the system executes tcister 
image processing (expansion) on thus received PDL data 
and -then writes it into "t'-he memory 106 (step 2). Ne^t L , 
the system checks whether daua processing (reception 
and expaiision) of one page of the PDL data has been 
completed (step 3) and, if it decides i ii is not 
completed yet, returns to step 1. 

If, on the other hand, it decides it is completed, 
the system detects production inf ormatiOTi, i.e. del.eci:s 
whether the production information is contained in uhe 

image data which has undergone raster image processing 

( step 4 ) . 

This detoctioi*i processing for production 
information, as described later, recognizes the 
production infox-mation by detecting the data of a mark, 
if any, attached to the image of the production which 
indicates i Ls copyright . 

Next, the system checks the results of detecting 
the production information given at step (4) (step 5) 
and, if it decides that the production information Vic^s 
been detected, it. does noi- send the image data to the 
image forming device 103 bu I: warns by display to the 
host computer 101 or the opei-ating unit. 250 Lo the 
effect tthat: it: cannot: ovitpuL i.he image data specified 
for prin-tout because -the it is production (see l;!»ter- 
described Fig. 8A) and stops image output ( st^ep 9) to 
finisb the proceiSJsing _ In trhis casti, the image data i 
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not: sent Uo the image forming device 103 but the 
processing is all finished in the pr.i n-L controllex- 102, 

At step 5, on the other hand, if it is dccidcfi 
that at step 4 no production .information has been 
5 detected in the image data at the time of production- 

information detection processing, the. system, along an 
ordinary flow of image prooossing, reads out the RGB 
raster image data stored in the memory 106 and executes 
logarithmic conversion to convert the RGB image data 
10 into MCYK image data ( step 6 ) , 

Next, the system sends thus converted MCYK image 
data to the image formjng device 103 (step 7), to 
finish image processing of one page of data lor the 
print controller 102, 
15 Ne3?:t, the system, according to the above-mentioned 

image forming procedure, forms an mage on a recording 
medium based on the image data sent from the print 
controller 102 and oui:put£ thus formed image ( stcsp 8 ) , 
to finish a series of image forming processes - 
20 The above processing prevents digital -information 

version of production fi^om being copied illegally. 

The following will describe detection processing 
for production information- 

Figs. VA to 7E shov; one example of a mark and a 
25 characi:er string which indicate that the Image data iy 

production. 

Figs. 7A to 7C show one example of a mark which 
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inaicaties that the imacgc data ±^ production; Fig. 7D 
ishows one example of a bax* code wl'iicti indicates that it 
is piroduction; and Fig. 7E shows one example of a 
character string which indicates that it is production, 
5 so that an image having any one of these shown by Figs . 

7A to 7E is accepted as production . 

[Detection processing for production information] 

In it premised here that an image with copyright 
has any certifying means indicative of production so 

10 that image data wiUh copyright which has undergone 
raster image processing may be detected. 

For example^ as shown in Figs. 7 A to 7D, a mark ot- 
bar code indicative of production is determined and 
registered beforehand . 

15 In this case, image data such as these px-oduction 

mark or bar code may be stored befox^ehand in the memory 
106 of the print controller 102^ so that the detecting 
circuit 105 would execute pattern matching between this 
data and the above-mentioned raster-information 

20 processed data, thus detecting the concerned mark. 

Alternatively, in place of using such a symbol a^.-? 
a mark or bar code, as shown in Fig. 7E, by providing 
production with a character string wh.ich indicates 
"production copy unauthorised" for example "This linage 

2 5 is production so cannot bci copied" beforehand, the 

detecting circuit 105 may execute block selection ori 
one page o£ the above-mentioned raster-image processed 



image dat;a^ -to subseqiient:ly exiiracii iihe characteir 
string data and recognize the concerned character 
string using a charaotcx^ recognirincg means, thus 
detecting that the image data is production to dotf::iCi- 
thG concerned character string. In this case also, a 
sampl(S of a cliaraoter string to be detected is st:oT-c_id 
beforehand in the memory 106 in the print controller- 
102. 

Further alternatively, in place of such characte.T- 
string as shown in Fig. 7E, an ID nunib&r indicative o£ 
an image with copyright is predetermined so that the 
d^t^cting circuit 105 may extracts character string 
data with that IP number to recogi^izie the concerned, 
character string using a character recognizing means, 
thus detecting that the image is pj/oduction * In this 
case also, the ID number uo be detected is stored 
beforehand in the memory 106 in the print controller 
102_ 

Also, there are some cases where, as mentioned 
above ^ it is desired to avoid adding an extra visible 
image such as a mark or character Lo an image with 
copyright. In such a case, such a technique may be 
considex^ed t:bat: px-oduc-tion informa-bion may be ma^^keid by 
embedding some add-on i nf ormat i on of a certain 
predetermined paiiLern of a few dots expx-e*?Kcici fox- 
example in a yellow color almost invisible to thc:-i l-iuman 
eyes into an image with copyright:. In this case also^ 
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such a me-thod may be considered that: this add-on 
informa-tion if^ stored beforehand in the niamory 106 so 
that the concerned image is detected to be production 
by detecting the color and the add-on pattern. 

Still further alternatively, to mask production 
information, for image data of each picture element, ci 
few high-order bits starting from the LSB C 3 feas t 
significant bit) may be used as a recognizing means. 
In this case, the production information can be 
subdivided for each picture element thus making it 
possible to recognize image data of interest in such a 
way that its only one portion is an image with 
copyright and the remaining does not have copyright. 
Therefore^ as mentioned above, only the portion of 
image without copyright of one page of image data can 
be output, thus preventing such portions as decided to 
have copyright from being output. 

Also, by forming a pattern by using thjs few bit 
data for each picture element as a total one page to 
recognize image with copyright, a production-copy - 
prohibiting mark etc- can be masked a^^ something like 
watermark into each one page of image data. In this 
case^ such a method may be considered that productioiT- 
recognizing bits for each picture element may be 
extir;^c::ted to c:on5^titutc-- one page o£ image data and thc^. 
execute pattern matching oii such pi^oduction marks as 
shown in fig. 7a to 7D, thus detecting that the data "i 
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pxoduci^ion . 

No-be here timt t.he method for detecting mage data 
of production is not limited i:o the above-menti or u:ic5 
example but may be any as far as it. scan detect that 
the data of interest is production. 

Figs, 8A and 8B show one example of a warning 
screen displayed on the display unit of the host 
computer 101 or the display unit of the operating unit 
250 of the image processing device 103 . 

In Fig SA corresponds to warning display to the 
effect that image data specified to be printed out 
cannot be outpvrl: (i.e., printed out) because it. 1^ 
production, while Fig. SB corresponds to warning 
display that image data specified to be printed out 
could not be output (i.e., printed out) because it is 
production , 
[Second embodiment 1 

Although the above first embodiment has been 
described in such a case of pex^forming prohibition and 
suspensioi"^ o£ image output all at the print control leT- 
102, such a conf iguralion may be given that the print 
controller 102 itself may decide whether image data 
should be prohibited from being oul.piit and send the 
information to the image forming device 103, Lhus 
causing it to stop imacje output- The following wi].l 
describe this embodiment- 

Process i-ng of PDL data at tlie px-int c.:oTit:rol Iot- 102 
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and -the image forming device 103 is desoribe^_ri with 
reference to a flowchart shown in Fig. 9- 

Fig - 9 shows one example of a second irucige-dcLta 
px-OCG^SSiri_g procedure, corresponding to the PDL data 
5 processing executed at the print control n er 102 and the 
image forming device 103. Note here that numerals 1 i-('> 
12 indicate relevant step numbers. 

Description of steps 1 to 5 for receiving PDL datci 
from the host computer 101 and detecting production 

10 information in image data which has undergone raster 
image processing is omitted here because thcty are l.he 
same as those of a procedure indicated by steps I to 5 
of the above-mentioned flowchart shown in Fig. 6. 
At step 5, the system checks the results of 

15 detecting the production information given at: step (4) 
and, if it has decided that it has detected production 
information, it reads out RGB raster Image data stored 
in the memory 106 and then performs logarithmic 
conversion to convert it into MCYK image data (st.ep 7), 

20 in order to create an image-output x:>rohibit ion signal 

and add it to the above-mentioned MCYK image data, 
causing control to go to step 9. 

If^ on the other hand, it decides that no 
production information has been detected in image data 

25 JDy the detection processing o£ the production 

information given at si.ep 4, tho system similai"ly rf^adi^ 
out RGB raster data stored in t:he memory 106 and t:hen 
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performs logari1:hmic converssion t:o converl: t:he RCD 
image data into MCYK image dj^tci ( Step 6 ) , causing 
control to go to step ( 9 ) , 

Next^ cit stGp [9), t'.he system sends the mCYR -inicjgc 
5 data to the image forming (device 103. 

Next, the image forming device 103 chocks wi^ether 
the image data sent from the printer control. I er- 102 ifi 
provided with th?^ image-ou l:put prohibition signal (step 
10) and, if it decides that the image-output 
10 prohibition signal has been added. It forms an image on 
a recording medium and outputs it (step 11), thus 
finishing a series of image forming processes * 

l£ it decides that the image-output px-ohibii.ion 
signal has been added to the image data s^nt from the 
15 printer controller 102, tihe system gives the host 

computer- 101 ox^ tiiC opex-^j-ting unit 250 warning display 
to the effect that mage data specified to be printed 
out cannot be output because it is production ( see 
later-described Fig, 8A) and also, to prohibit the 
20 image data being output, converts the image data all 

into a blank image and outputfs iL (si-.ep 12), thus 
finishing ii.s processing. 

The above pr-ocessing is able to prohibit digiti^f^d 
production from being copied illegally, 
25 [Third embodimenti 

This embodiment is described in a case of one 
exaniple of data processing lor embedding production 
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information into image data i.o mask it, particularly in 
a case of detecting an inconspicuous or invisible 
digital watermark indicative of production in order to 
detect production inf orma i.ion . This emfood.i mtint iy 
5 specifically described in such a case that a digital 
watermark indicative of production constitutes a 
production mark as image data for the entire one page. 

The following will describe operations, with 
reference to a flowchart shown in Fig* 10^ of 
10 processing PDL data at the print controller 102 cind tho 
image forming device 103. 

Fig. 10 is a flowchart illustrating one example o± 
a third image-data processing procedure, corresponding 
to the PDL data processing at the print controller 102 
15 and the iniQge forming device 103- Note here that 

numerals 1 to 12 indicate the step numbers. 

Description of steps 1 to 3 for receiving PDt. da La 
from the host computer 101 for raster image expansion 
is omitted here because they ere the same as l"-he above- 
20 mentioned processing procedure of steps 1 to 3 of the 

flowchart shown in Fig . 6 , 

At step 4, the system checks, as follows, image 
data which has been raster image processing to detect 
production information therein. First, the system 
25 extracts the low-order three bits starting from the LSB 
for each picture element l.o create a digital -v^a l.ermark 
signal which is a property signal- The system uses 
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"this digit;a I -watermark signal as one page of datci to 
create digital-watermark information and image data^ fso 
that it may perform patterri matching to search this 
watermark information for a mark such as fOT- example 
those shown in Figs. 7A to 7C, thus detecting the 
production information , 

Next, the system checks i.he results o£ detecting 
the production information given at step 4 (step b) ad, 
i£ it decides that the prodviotlon information has been 
detected, it reads out RGB raster Image data stored in 
the memory 106 and then performs logarithmic converfiji on 
to convert the FOB image data into MCYK image data and 
also coverts the image data, to prohibit its output, 
into a blank image {step 7) to create an i niage-Ovi Lpu L 
prohibition signal and add it to the image data ( step 
B), thus causing con-trol to go Lo step 9. 

If, on the other hand^ it decides that the 
production information has not been detected in the 
image data by the detecting processing for the 
production information at step 5, the system reads out 
RGB rastex^ image data stored in the memory 106 and then 
performs logarithmic conversion to convert the KGB 
image data into MCYK image data (step 6), thus causing 
control -to go to step 9. 

At step 9^ the system sends thus converted MCYK 
image data to the imago forming device 103, whdc>i then 
forms an image on a recording medium and outputs it 
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( s-tep 10 ) , 

Next, the image forming device 103 checker; whol-i"ic=^r 
-the image-output prohibition signal Is added to the 
imane data sent from the print contiroller 102 (step 11) 
and, if it decides that the output prohibition slgnai 
lias not been added to the iinege data^ it finishes a 
series of image forming processes - 

If, on the other hand, it decides that, the image- 
output prohibition signal has been added to the image- 
data, it sends, to the host computer 101 or the 
operating unit 250, warning display (see Fig. 8B) to 
the effect that the image data specified to be printed 
out cannot be output, beoaaise it is production, thus 
finishing a series of image forming processes, 

Although the f3owchart shown in Fig. 10 has been 
described in a case of converting image data into a 
blank image in the print coi^troiler 102, such a 
configuration may be employed that if the image-output 
prohibition signal is detected in the image processing 
device 103, the image data may be converted, in order 
not to be output, into a blank image and output as 
formed. 

The above processing makes it possible to use a 
production mark in which a digital watermark is 
constituted as image data of the entire one page, to 
detect a production image whose production information 
is embedded into the image data to mask it so as to 



p37oh±bi"t "the ou1:put:"ting ot t.lnet one page oT image data 
of -th^ production, thus preventing digitized produc-:Lion 
images from being copied iiiegaiiy without adding ciin 
extra visible image suoh ay a mark or character to the 
production image * 
[Fourth embodiment] 

Although the above third embodiment has been 
described in a case where a digital watermark 
indicative of production constitutes a producliion mark 
as an entire one page of image data, such a 
configuration may be employed that the digital 
watermark indicative of production corresponds to each 
picture element. The following will descr-i bo this 
embodiment . 

The following will specifically describe 
operations of PDL data processing at the print 
controller 102 and the image forming device 103 with 
reference to a flowchart shown in Fig. 11. 

Fig. 11 is a flowchart illustrating oi^e e^^ample of 
a fourth image-data processing procedure^ cor-responding 
to the PSL data processing at the. pr-int contT-ollcr 102 
and the image forming device. 103* Note hox-c?. that 
numerals 1 to 13 indicate the step numbers . 

Description of steps 1 to 3 for receiving PDL data 
from the ho.st computer for raster image eiipansion is 
omitted here because they are the ir^ame as l.he 
above-mentioned steps 1 to 3 for processing procedure 
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o£ -the flowchart; shown in Fig- 5- 

At: s-tep 4, the syst.em detects checks, as follows, 
image data which has undergone raster image proce^^^iinq 
-to dcitect production information therein, i:irst, the 
5 system extracts the low-order three bits starting from 
the LSB of each picture elomeni: to create a digital 
watermark signal, which is a property signal for each 
picture element, and image data. Using this digital 
watermark signal, the system performs pattern matching 
10 on predetermined production data, thus detecting 

production information about each pi.cture element. 

NeKt, the system checks the results of detecting 
the production information given at step 4 ( step 5 ) 
and, if it decides that the production information has 
15 been detected for any picture element in the image 
data, it creates an image-output prohibition signal 
indicative of image-output-prohibited data ( step 7 ) and 
reads out RGB raster image data stored in the memory 
106 and then performs logarithmic conversion to convert 
20 the RGB image data into MCYK image data ( step 8 ) and 
then converts only such image data as detected to be 
production into a blank image to prohibit outputting of 
such portions of image data (picture elements) to be 
detected to be production (step 9), thus causing 
25 control to go to step 10, 

If, on the other hand, it decides at step 5 that 
the production infox-mation has been detected in none oi 
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■the pic-tux^e elements in "the image da-ta as a resuli: of 
det:ecting the production information given at step 4, 
the system reads Out RGB raster image data stored ±n 
the memory 106 and then pc.r±armi=i logarithmic conversion 
5 to convert the RGB data into MCYK image data (step 6), 

thus causing control to go to step 10- 

At step 10, the system sends thus converted MCYK 
image data to the image forming device 103^ which then 
forms an image on a recording medium and outputs it 
10 (step 11), 

NeKt, the image forming device 103 checks whethex" 
the image-output px^ohihii.ion signal is added to the 
image data sent from the print control lor 102 (step 12) 
and, if it decides that the image-output prohibition 
15 signal has not been added, it finishers a scries of 

image forming processes - 

If, on the other hand, it decides that the image- 
output prohibition signal has been added, the system 
sends warning display (see Fig. 8B) to the effect that 
20 the image data specified to be printed out cannot be 
output because it is production, to the host computer 
101 or the operating unit 250 (step 13), thus finishing 
a series of imago forming pr-ocessos . 

Although the flowchai-t ^fihown in Fig. 11 has boon 
2 5 desoiribed in a oases of conv^^irtirLg image dat:?^ into a 

blank image for each picture element in the print 
controller 102, such a configuration may be employed 
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that: if the iniagc-Output prohibition signal for each 
pictuire element is detected in the imacj*^ proaessing 
device 103, the concerned picture element would be 
convex-ted, to prohibit the outputting of it^5 
5 corresponding image data, into a blank image to form an 
Image and output it. 

The above processing makes it possible to detect 
production information (digital watermark) which is 
embedded corresponding to each picture element so as to 

10 prohibit the outputting only of such image data of 

picture elements corresponding v.o the production image, 
thus outputting the information of portions other than 
the production image without adding an extra visible 
image such as a mark or character to the production 

15 image, to prevent digitized production from being 
copied illegally. 

Although this embodiment has been described about 
a means of converting an output signal into a blank 
image as a means of prohibiting the outputting of an 

20 image, such a configuration may be employed as using a 
method for scramblxng for example any solid-black 
pattern image or data other than an original image or 
changing its magnification before ouLputting it or 
printing a message such as "production copy 

25 unauthox-iscd" . 

[ F i f t h emb od im e n t ] 

Although the above-mentioned embodiments have 
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-taken a measure to prevent: ci r^ormc^l printout: when 
production information was detected, the following 
embodiment uses sucl^ a configuration that full-color 
data, production information (i.e., image-output 
prohibition signal), and a password (which is detailed 
later) arc embedded into PDL da La received at the print 
controller 102 so Lhai. i.he image-OLitpat prohibition 
signal end the password may be written into the memory 
106 at the detecting circuit 105. 

Fig* 12 is a flowchart Illustrating the expansion 
processing of the PDL data by the print controller- 
shown in Fig . 1 - 
Step S1201: 

The system receives PDL data in for each 
prescribed unit from the host computer 101. The PDL 
data is received in one or multiple of such a unit as 
fitting to processing, e.g. units o£ a few bytes, one 
page, or one line. 
Step S1202: 

The system analyzes thus received PDL data and 
performs raster image proce.ssing to convert it into 
raster image data (i,e,, RGB raster image data) and 
then writes it into the memory 106. 
Step 31203: 

The system r-c-i^oeiives each page of the PDL data to 
decide whether it has undergone expansion processing- 
If^ as the results of this decision, it is found 



-that; -the expansion proaessing has not: been oompieted 
for thai: one page of the PDI. data^ control returns to 
step Sl^Ol to permits the system to repeat steps S1201 
to S1203 agciin on the POL dal:a received in pro^scr-ibcui 
units. When that one page of the PDL, data has 
completely been expanded, control goes to step Si20<l - 
Step S1204: 

The system checks the RGB raster image dcJta 
(hereinafter called "image data" simply) obtained by 
the raster image processing executed at step S1202 to 
detect whether that data contains production 
information. This detection processing of production 
information, which is detailed later, refers to such 
processing that detects a mark (i.e., production 
information) indicative of copyright froii] image dyty 
subject to processing. In this case, a password, which 
is embedded together vjith the production information, 
of ' the concerned image is also detected. 
Step S1205: 

Based on the results of the detection executed at 
step S1204, the system checks whether the production 
information has been detected from the mage data, that 
is, decides whether the production information has been 
added to the image data subject to processing to 
indicate that the concernad image data Is producLioii. 

If the results of this check indicate that the 
image data is production^ control goes to the. 
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processing st;art:ing from step S1206 and, if no1:, goes 
■to -the proC€^ssing star-ting from step ST 212. 
Step S1206: 

If the image data subject to processing is 
5 production, it is copy-pro tec i.e.ci to prohibit the 
ou'Uputting the image. 

Therefore, here first, to check a password given 
to release the above-mentioned copy-protection, the 
password-Check counter is returned to "0". 
10 Step S1207I 

The System causes the host computer 101 to display 
such a password-entry screen as shown ±n Fig. 13A, to 
esK: the user to enter the password. 
Step 1208: 

15 The System compares the user's password entered on 

the password-entry screeai displayed at step S1207 to a 
password detected by the detection processing executed 
at* step S1204, to decides thc^SG two passwords aC[ree 
with each other - 

20 If it is decided that they do not agree, contro.l 

goes to the processing starting from step Si209 and, if 
they agree, control goes^ to the processing stax^ting 
from step S412, 
Step S1209: 

25 If the laser's pA?;sword did not agx-cc-:i with the 

image data's password, the system adds "1" to the 
password-check counter which has been cleared at step 



S1206. 
S-tep SI210-. 

The sys'tein decides whet.liejr, as a result: ol 
processing executed at: step S1209, the password-check 
counter inciicates a value of "2" or higher. This 
decision is made to permit the usc?-r to ente^r his 
password again if he has mistook in entry of the 
password. 

If it is decided that the counter value is loss? 
than "2", control returns to step S1207, to permit the 
user to enter his password again. If, on the oCher 
hand, the value is "2" or higher, that is, if the user 
has mistook the entry ot* his password twice, control 
goe^ to suep S1211- 
Step S1211: 

If the us^r has mistook the entry of the passwor-d 
twice ^ the system does not , send image data subject to 
processing to the printer 103. "With this^ the 
concerned data is prevent from being output- Insi:oad, 
the system causes ttie host computer lOl to display 
warning such as shown in Fig. 13B to the (Effect that 
Spf^Cified image data cannot be output because 
disagreement between these two passwords. Then the 
system finishes the processing . 

Tbus^ in this case, the image data ±^ not. fsenL Lo 
the printer 103, to finish the processing all in t.hc 
print control l<^r 102, 



S-tep S1212: 

If the results o£ decision at step S405 inciicate 
that the image data subject to proce^sii^g is not 
production or those at step S408 xndicat.e that the 
password of the image data which is production has 
agr<>ed with the user^s password, the systein, along an 
ordinary image processing £low^ reads out imago data 
(i.e., RGB raster image data) stored in the memory 106 
and then performs logarithmic conversion to convert 
that data into MCYK image Oata- 
Step S1213: 

The system sends the MCYK image data obtained at 
step S1212 to the printer 103- With this, image- 
processing of one page of image data is finished. 
Step S1214: 

The printer 103 forms an image based on the image 
data sent from step S1213 on a recording medium 
according to the above-mentioned mage forming pirocedure. 
and outputs it. 

If there is provided a plurality of pages of image 
data, the system executes processing starting from .step 
S1201 again. 

The above-mentioned detecting processing of 
production information e5?:ecuted at step S1204 is 
specifically dlescrifoed as follows . 

Tt is premised here that the production image data 
has some certifying means (I.e., px-odiiction 



information) indicative of product;ion so that it- can ho. 
decided whether raster- image processed image data is 
production image data (i.e., image data with 
copyright ) . 
(Certifying means .1 ) 

For example, as shown in Figs. 14A to i4D, a mark 
or a bar code indicative of production is determined 
and registered beforehand and the embedded into 
production image data. 

In this case, t:ne above-mentioned mark or bar codct?. 
already registered is stox-ed ix^i the memory 106 in the 
print controllei^ 102 beforehand. With this, the system 
performs pattern matching between this stored data and 
the above-mentioned raster- image processed data to 
detect the concerx^ed mark^ thus deciding whether the 
image data subject to processing is production. 

As for a passwOT:d for image data of production, on 
the other hand, in place of a mark and bar code, for 
example the above-mentioned ID number of the cOTic:::eT:'ne-d 
image data (production image) determined beforehand 
such as shown in Fig. 14E Is embedded. 

In this case, the system extracts as charactcr-- 
string data the ID number from image data subjeoi. i.o 
processing in which that in number is embedded, i.o 
recogni2:e the concex^nad character string by uHiny a 
charac lier-x-ecognl 7.ing means, so as to confirm a 
password correiSpOnding to that number (becau55e this 
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password coirresponding to the ID number is a sox't of 
data piece encrypted by an cx-ypt:o-analyzing circuit 
included ion r.he detecting oiT'ouit 10b), thus 
recognizing the password. 
5 Note here that only the password data may be used 

as bar-code data such as shown in F'ig* 14D. 
( Certifying means 2 ) 

If, as mentioned above, in order- to avoid adding 
an extra visible image such as a mark or character to 
10 production image data, the production information is 
masked by for example embedding beforehand a few dots 
of predetermined pattern of add-on information 
(expressed in yellow hard to see with the l-iuman oyos ) 
into the concerned image data. 
15 In this case also, the above-mentioned add-on 

information is stored in the memory 106 beforehand^ i-O 
detect the color and i:he. add-on pattern, thus detecting 
tKe production and its password - 
(Certifying means 3) 
20 A few high-order bits starting from the LSB of 

each picture element of image data are used as a 
certifying means in order to mask the production 
information (digital wa Lermark ) . 

In this case, since the production information can 
25 be subdivided for each pio-turo:- olc-fimen-t , it is possible 

to recognize only a portion of certain image data as a 
production image and the remaining as a non-production 
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image. Therefore, as men-fcioned latter, it; is also 
possible "to output only the portion of an non- 
production image of one page of image data and not. Lo 
ou-tput those portions that have been decided to be 
5 production image dal.a. 
(Certifying means 4) 

By forming a pattern using the above-mentioned few 
bits of data for each picture elemeni;. as the entire one 
page for "recognition of production images, a production 

10 prohibition mark etc- is e.mbedded ay a watoimark ini.o 
one page of image data to mask each image data - 

In this case, the system extracts the production 
the reoogni2;ing bit data of each picture element to 
constitute one page of image data and then perform 

15 pattern matching between such a mark and a iDar code as 
shown in Figs. 14A to 14D, thus detecting that it is 
production. 

Note here that the method for detecting production 
information or a password from image data subject to 

20 processing is not limited to the above-mentioned 

methods described in Certifying means 1-4, 5i>o that any 
method may be used as far as it can det:ect that 
concerned image data is production or it can de L:ec1. a 
password . 

25 (Sixth embodiment) 

This embodiment is applied for example in an image 
forming system 1500 such a?; .shown in Fig. 15- 
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This image foxTiiir^g sys-tem 500 has a oon^ igura l.lon 
similar to that of the^ above-me.nLioned image forming 
system 100 shown in Fig. 1, except that whe.n an image 
is pirohibited fi-Om being output buoGUSe. its production 
information is detected, this system 500 acop.sses l.he 
author's side host computer 1502 connected to tht- prim, 
controller 1503 over a network, to release that state 
of image-output prohibition. 

Detailed description of the above-mentioned image 
forming system 1500 shown in Fig. 15 is omitted here 
because its components operating in a manner similar to 
those of the abovGj-menticned image forming system shown 
in Fig, I are indicated by the same reference numex-a 1 s . 
In the image forming system 1500, the above- 
15 mentioned author's side host computer (hereinafter 

called first host computer") 1502 is connected to the 
print controller 1503 over a network. 

The print controller 1503 transfers the 
information which identifies production's image data 
20 and its password with the first host computer 150'^^ eru.l 
also transfers output permission for image data to be 
output from the printer 103 or production's image data 
with a general user's host computer (hereinafter called 
"second host compuLer" ) . 
25 The host computer 1502, like the above-mentioned 

host computer lOl shown in Fig. 1, converts image da La 
into infornmuion coded in a page description language 



i 
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( PDL here) and spends i 1:q l.ha print cont:i:oller 1503 
via a connecting cable, 

ThereiforO;, the print controller 1503 analy^io^j; Pni. 
data sent from "the second ho^9t computer and converts it 
5 int:o raster image data and t;hen sends it. to the printer 
103 via the connecting cable. During this process;^ Ing , 
if piroduction informal-ion is detected from among t.h;^t 
rast;er image data by the detection processing, the 
system first obt:ains acceptance for printout permission 

10 from the concerned author ^ s side "the first host 

computer over the network and then sends the image data 
to the printer 103, 

Fig. 16 is a flowchart illustx'ating the e^panf^ion 
processing for PDL data executed at the print 

15 controller 1503. 

Detailed description of the above-meiitioned 
flowchart shown in Fig. 16 is omitted here because its 
like steps are indicated by the same step numbers as 
those for the flowchart shown in Fig, 12. 

20 Steps S1201-1205: 

The system receives PDL data from the second host 
computer 1501 and then converts it into rasto^:^ imago 
date, to detect production infox~mation and the password 
based on that image data. 

25 If the results of this detection processing 

indicate that the concerned image data is production, 
control goes to processing starting from step Si60l, 
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This processing differs from that in the above- 
mentioned fifth embodiment. 
Step S1501: 

l£ the concerned image data is production, to 
check the password in order i:o release a oopy- 
protection state, the system causes the second host 
computer 1501 to display a password-entry screen (see 
the above-mentioned Fig. 13A), to ask the user to enter 
the pas sword - 
Step Sl602i 

The system sends to the author's side first host 
computer over the network bhe user's password ontercd 
on the password-entry screen at step sieoi tocjether- 
with the ID number for identifying the corresponding 
mage data- 
Step S1603: 

Checking of the password for the ID number of the 
im^ge data sent at step 51602 is executed in the first 
host computer - 
Step S1604: 

If as a result of check executed at the first host 
computer 1502 et step S1603, the password cannot be 
icaentified, to prohibit the outputting of i.he concer-T^e-d 
image data, the system does not send that image data to 
the printer 103 but does it causes the second host 
computer IbOl to display warning to the effect that the 
specified image data cannot be ovitput because of 
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disagi^Gomant; of the password (see iihe above -men trioTiticl 
Fig- 13B). Then, this processing is finished. 
Step S1605; 

Tf, as a result of chock cxttcutcscj by the fir?;!, 
host computer at step 1603, the password is identified, 
the system issues output permission to the second host 
coniputer . 

Then, the above-mentioned steps S1212 to S1214 are 
executed, to output the concerned image data from the 
printer 103 . 
( Seventh embodiment] 

The above-mentioned sixth embodiment employs such 
a configuration that to release an output-prohibi l:ed 
State for image data provided when production 
information was detected from among the image data, the 
system accesses l.he authai-'^^ side first host computer 
connected with the print controller 1503 over the 
ne-twork to release the image-output-prohibi Led sl.al.e* 

In this seventh embodiment^ however, instead of 
prohibiting the outputting of image data, the system 
gives (the user of) the second host computer 1501 the 
warning to the effect that the coi^cerned data i s 
production and then pi-ompts the author's side fir/st 
host computer 1502 fOT- accepting accounting and then 
pos ts -the conc3S3rnc^d output information -to t:he5 aii+ihoT ' 
side first host computei' 1502 according to the number- 
of printout sheets given by the. second host compul.er 
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1501 (user) a the printer 103, for ciutomaiti o 
accounting , 

For this purpose, expansion of PDL data executed 
at the print controllf^r 1^03 comes in for exaniplo ^'uich 
5 processing a.s shown in Fig. 17- 

Detailec3 description of the flowchart shown in 
Fig. 17 is omitted here becaus?c its like steps are 
indicated by the same step numbers as those for the 
flowchart shown in Figs. 12 and 16. 
10 Steps S1201-S1205: 

The system receives pr^C data from the second host 
computer and then converts it into raster image da La, 
to detect the production information and password from 
among the image data. 
15 If the results of this detection processing 

indicate that the concerned image data is production, 
control goes to processing starting from step S1701- 
Th±s processing differs from that of the above- 
mentioned fifth and sixi.h embodiments. 
20 Step S1701: 

If the concerned image data is production, the 
system gives the second host: computer IbOl the warning 
to the effect that accounting is imposed if for example 
such printout as shown in Fig. IS is executed in order 
25 to notifies it of the specified mage data (image to be 
printed out) being production. 

This warning screen pr-ompts for the execution of 
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printou-t of the information (printout Lnlormation ) oi 
image data to be printed out and, at the same Lime, for 
acceptance of its automatic posUix^g to the author's 
side . 
Step 

The system decides whfithcx-^ a user ^ s instruction 
given on the warning screen at stop 1701 indicates 
acceptance of accounting and printout of the image 
data, 

l£ the results of this decision ii'^dicatc user's 
acceptance for accounting, control goes to tha abovc?.- 
mentioned processing starting froni £3tep SI 21 2 and, 
otherwise, goes to step S1703 . 
Step S1703: 

If the user does no accept accounting, the sy^ L:em 
does not send the image data to the printer 103 but 
stops the outputting of the image data. Tlien, l.hli-i 
processing Is finished. 
Steps S1212-S1214: 

If, on the other hand, the usei^ accepts 
accounting, the system, as mentioned above, sends the 
image data to the printer 103. Witln this, the printe.r 
103 prints Out Lhe concernad image dat.a (i.e.- one page 
of printout). Then, control goes t.o step S17C]4. 
Step S1704: 

This step is executed even when the concerned image 
data is not production. Therefore, the system decides 
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whether image datct prlnte-d out: by Lhe printer 103 is 
procSuction. 

Only if the results o£ l;his decision indicate that the 
printed out image data .is production, control goes Lo 
b step S1705 and, otherwise, thi.s procO-iSfting is fini<;hed. 

Step S1705: 

If the printed out image data is productiori, tlie 
system, for example, causes the uSGr side second hoftU 
computer 1501 to display output information of the 

10 production including accounting information such as 

shown in Fig. 19B, Tlie System also causes the author's 
side first computer 1502 to display printout 
information of the production such as shown in the 
al:)Ove-mentioned Fig- 19 A. Then^ this processing is 

15 finished . 

( Eighth embodxrnent ) 

The seventh embodiment has been described in such 
a case that the author's side host computer performs 
accounting, to permit: production to be printed out, 

y^O The eighth embodiment, on the other hand, 

particularizes, when image data is printed, an authox" ' s 
host computer based on copyright information contained 
In a form of a digital watermark in the image da La, 
thus making it possible to obtain an image dal.a lifti-. 

25 relating to the image data Lo be printid^d, fr-om this 

author's side host computer - 

Fig, 20 shows a configuration of the eighth 
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embodiment. Fig. 21 shows a flowchart: of the 
processing by the eighth o.mbodimenl: . 

When it is instructed to print a dcsiracl image, 
data file (Step S1201 ) , the. user side host computer 
2004 activates its own software for detecting 3 dig.-ii..al 
watermark (which may he embedded into the above- 
inc^ntioned three bits starting from the LSB or 
superimposed on a particular frequency in the imcige ) 
(step S2102), thus detectin<5 the digital watermark 
embedded in the instructed image data file (step 
S2103). 

Motet here that if the digital-watermark detecting 
software has been activated already, step S2102 ccjn bo 
passed. 

Thus detected digital watermark contains 
information about the above-mentioned image data 
desired to be printed and also information of the 
author's side host computer. 

The information abut this image data desired to be 
printed is (1) address information of the auLhor's side 
host computer which manages the copyright of the other 
paintings if the above-mentioned desired image da La i?; 
one panting of his, and {y.) address information of a 
tu>st compTjter which manages the notes of the other 
melodies of a composc^r if that de.sired image data is 
the dooumeni. of one of his, and (3) address inlormation 
of the author's side host computer which manages the 
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ot:her books if -that desired -i mage dat:a is one of hi^:;, 
and (4) addx-GSs information of the auLhor's side ho^3t 
computer which manages the other photogreiphs- of a 
photog^rapher i£ that desired imaQ^ data is one of t.he 
5 photographs? he took- 

Next, the digital-watermark detecting software, 
based on the information x^elating to the desix-ed 
printout image data which is detected, gives the user 
side host computer 2004 on its display the inquiiry for 

10 whether it wants to obtain images relating to an image 
desired to be printed (step S2104)- 

If the user has replied YES to this inquiry, the 
user side host computer 2004 uses the addre^ss 
information obtained from thfei detected digital 

15 watermark, to access the home page of the author's side 
computer 2001 over the Internet (step S2105), thus 
Obtaining an index (the above-mentioned image data 
list) of the charge of the image contents possessed by 
the author's computer 2001 as shown in Fig. 23* 

20 Note here that the image contents may not be 

introduced with thei-r produce names (as shown in Fig, 
23) but be displayed as thumb-nail mages (down-sized 
images ) . 

The user of the user side host computer 2004 
25 se^leo-ts ea dci^sired imagfes fx-cDiii among Lhe above-man Lioneci 

index and the thumb-nail images, to enter the cred:it 
caT-d numbex- and enter- a transmission in.struction , 
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■thereby causing iihe author ' side host computer 2001 to 
send the selecteca image to the user side hoyt compuUer, 
Also, t;he charge for the selected image is aooounl:ed to 
■the credit card at tha author side host computer 
5 2001. 

Also, if NO is replied at step S2104 or y 
suspension instruction is given at step S2107, the 
processing is finished. 

The image, when received, is printed by the 
10 printer 103- 

Although the above-mexntioned embodiment separately 
activates the digital-watermark detecting software, i^ 
print driver, when the user side host computer 2004 
instructs printing, may be provided with functiozis of 
15 the digital -watermark detecting software and Internet- 
connecting software so as to execute processing of step 
2103 and the subsequent shown in Fig, 2 J in response to 
a printing instruction. 

Also, although the above-mentioned embodiment, is 
20 limited to a case of still images as image contents 

received from the author's side computer because of its 
conf igurat j on of printing image data at the px ini-.cr 
103, the contents may be reproduced as movies or 
musical notes by using the image-reproducing decoding 
25 55ofr.wca.x-c; or speech-reproducing decoding softwa-re of thci 

user side host computer. 

In th.is casci^, the f^y.stam instructs one frame of 
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image of a movie or an image of the music jacket, to 
d&t<sct a digital watermark for thi.*3 image, thus 
executing si.eps S2105-:?. lOft . 

Also^ although the above-mentioned embofiiment has 
5 such a configuration so as to receive image contents 

only from the author's side host computer 2001, when 
the digital watermark infox^mation contains addresses of 
author's tiost computers at a plurality of area^S- 
(author's side host computers 1, 2, and 3), an index oi 
10 the image contents and charge may be received from thfi 
author's side host computers ol the plurality of areas 
and displayed sequentially at the user side host 
computer , 

Also, if the digital -watermark detecting sofi-ware 
15 takes for its processing excc^iLion so long a timc£i 

(e*g*, three seconds or longar) as to inflict some 
stress on the operator, the system may execute step 
S2104 after step S2101 in order to execute steps S2102, 

S2103, S2105 when YKS is replied. 

20 Also, although the flowchart shown in Fig. 21 is 

used in description, the means for executing the 
processes shown in Fig, 21 -i of course provided to 
each component shown in Fig. 20, 

Also, the above-mentioned embodiment of coursse can 
25 be ac^iieved also by s;upplyirig a storage, medium which 

stores a program code for .sof Lv/are wlilali realizes the 
functions of t.he host, computer and its terminals of 



- 52 - 



each of the abovG-men-tioned ombodiment:s "to the system 
or devicei so that b computer (or CPU or MPU ) of i:hat 
system or device may read out the progi-am code stoi-cd 
in the ^storage ined.i.um and execute it.. 
5 In this case, the program code itself read out 

from the storage medium real ises the functions ol eac)i 
embodiment, so that the stox-age medium which stores 
that program coda constitutes the present invention. 
The storage medium for supplying a program code 

10 may come in a ROM, floppy disk, hard disk, optical 
disk, magneto-^optical disk, CD-ROM, CD-R, magnetic 
tape, nonvolatile memox-y card, etc. 

Also, by execut.ing a program code I'oad out by the 
comput&r, the functions of each embodiment not only car-i 

15 be rts^alized but also the OS etc. operating at the 
computer can execute part or all of the actual 
processes, of course thereby realizing the funct.ionK; of 
each embodiment. 

Also, after a program code read out from the 

20 storage medium is written into a memory provided to a 
function-expansion unit connected to an expansion- 
function board inserted into th^i compiiter or a 
f unction-tixpansion unit connected to the computer, 
based on instructions of that program code, the CPU 

2 5 etc of -fcliat f unct 1 on-esxpansion board or thr^t function- 

expansion unit may of course execute pari: of all of the 
actual processes, thereby realizing the functi.onj^ cjf 
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each embodiment . 

As described above, the above-mentioned embodiment 
detects whether px-^odetermined information (w>iioh i^; 
indicative of produot.ion) in image data when thai- image 
b datci is sent from the user side terminal and to be 
output from an output device (i.e., image forming 
device, printer, etc- ) * If the results of this 
de-tection indicate the pz'esence of the production 
information, the system prohibits the outputtinq oi 

10 that image data at the output device. In this case, 

the system causes tho user side terminal i:o for example 
display a screen which prompts it to enter a password 
issued £rom the author's side or confirm that the 
concerned image data is producUion, thereby releasing 

15 an output-prohibited state. o£ the above-mentioned image 

data based on information [i^e,, information of the 
entered password or accounting acceptance) returned 
from the user side terminal. Alternatively, the system 
s^nds that information retuimed from the user side to 

20 the author's side terminal, to release an output- 
prohibited state of the above-mentioned image data 
based on i.hat returned information (i.e., information 
of the results of checking the password etc. ) - 

With this, when the user who asked -Por the 

2b outputting- of iiTiage data which i s produc^tion has 

permission from the auLhor's side, an output -pr oh ib i Lc-u-3 
state of that image data is automatically released. 
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thus peirmi-t-ting an output- device to output it. 

Specif 3 c:ally ^ a device or systein wliich to px-ottict 
digitized production and prevent its illegal copying, 
detects production informaition (i.e., pj:cdetermined 
5 information) embedded in that image data to prohibit 

its output can release a printout-prohibited stai-ft oi 
the production when it has obtained permission from i.hc-\ 
author ^s side, so that it can making svjitch-over 
between a copy-permitted state ai^d a copy-proTiibi Le.d 

10 state according to whether it is authorized to output.. 

the production image. Also, it can automatically give 
accounting to an image which is output production and 
also causes the author ^ s side and the usex" to confirm 
that accounting information locally. 

15 Therefore, it is possible to automatically make 

switch-over between a copy-permitted state and a copy- 
prohibited state according to the typfe of production 
while securely protecting che production. 



WHAT IS CLAIMED IS: 

1. An image processing appax-atius which comprL?;eF;: 
deirecting means for del.e.cting inf OxMwal-.ioi:^ relat.-i tk.] 

to invisible copyright from image dat:a which is input ; 

and 

control means for controlling the print: ol said 
image data according to information relating Lo said 
detected copyright. 

2- The image processing apparatus according i.o 
claim 1, wherein the information relating to said 
invisible copyright, is digital watermark information. 



3. The image p-roces^^ing apparatus accox-ding to 
claint 1, wherein said control means prohibits said 
print . 



4. The image processing appaxal.us according to 
claim 1, wherein said contx-ol means prohibits the 
output of said image data to a printer which performs 
said print- 

5 . The image processing apparatus according to 
claim 1, wherein said contr-ol meant'^ output?; a control 
.sign^il whxoh givers £5a.id iittage doto to a printer whi r:h 
performs said print to prohibit the print o±" said imag 

data , 
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6, Th.e imago processing apparatus v%rhich fciTtho.r 
cjomprises identifyinQ means for iden'bif y i nq a passwrji d 
embedded in said image dalia, wherein said cs.oi\\..rol mean:.-; 
permits l:he print-, ol an iiricicjc^ which corresponds l.o said 
5 image data when tha same pa^-;sword as hiaid password isi 
input , 

7- The image processing apparatus aocording to 
claim 1^ farther comprising: 
10 ID det:ecting means for detecting ID information in 

order to identify said image data from said image data; 

inputting means for inputting a passwox/d by a 
user; and 

receiving means fox- ^^anding said iD information 
15 and a password to an author ' side device to receive 

information of print permi 5555 ion for said im^go 
f ormation. 

8. The mage processing apparatus accord iruj Lo 
20 claim 1 which further comp7rise.f^ ins t.:ructing meciiiy for 
instructing acoe.pt ance fox- accounting for the pri. r^t 
using said image data to an author '^f; side device, 
wherein said control means permits the print o£ said 
image dat.a in response to said instruction. 



9. An image processing appcix-a-tus which compT-i se:.-.^ : 
detecting mean.s fox* c3<:M.ec Ling a digit cil wai.ermarK 



cont:a.inec3 in image dsta; 

obtaining inci=in5? lor obtci i ti i iiQ an addT'e5-i-'-^- oi a 
device wJiich holdy a data list T/elai.ing to ysid image 
delta fT-om said detected digital waitexnnark inf ox-nici tion ; 

receiving means for T-eiCOiving a data list from 
said device accox-ding to said cjddx-af;£^; and 

dai.a receiving moanfi for x-ecelving data selectc-d 
by a user from said image data list, 

10, The image processing apparatus accox-ding to 
claim 9, wherein said data is an image, a speec>i or a 
movie - 

11. Tine image pr-oec-i^fting apparatus accox-ding to 
claim 9, where.in said dai.a list writes thox^ein a 
plux^ality of data pieces and charge for said p3ui-aliLy 
of data piGces. 

12. The image processing apparatus according to 
claim 9, wherein said dal-.a reception is pe-T formed by 
sel.ecting xiser ' s desired data from f.^aid dat.a list and 
■inputting Lhe number of a cash card of .said user, 

13, Thei imago procGSfting apparatus according i:.u 
claim 9, wh^.x-p_ln i^^aid dt-=itr=i data of another produc*:^. 
of a puintfir who has wx^iLLen said image data- 
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14. Tho image pT-ocft?;sing apparalius ciccording to 
claim 9, whBT-cin said driiLa is data uf anothczij proc-luoe 
of a composer who has written ci musical note 
coi^responding to said imsgo data. 

5 

15. The image procossing apparatus according to 
claim 9, wherein said date i^:? data of another prochjcio 
of an author who has writttm a book according to 5j:ciid 
image data. 

iO 

16. The image, processing apparatus cicoording to 
claim 9, V7herei n j^aid data Is data ol anothfir produce 
of an photographer \"/ho has takei-i a photograph 
corresponding to said image data. 

15 

17- The image processing apparatus accorciii-ig to 
claim 9, wherein said address comprises a plurality of 
addresses and said data receiving meany receives a data 
list from a plurality of devices- 

7.0 

18. An image pi-ocessing method which comprlse^.-^ : 
a step of detecting information relai.ing to 

invisible copyright from :i nput image data by detecting 

meeans; and 

^5 a. step of conti-nlling tho print of f^riid image dal'O 

according to information relating to said detcci-ed 
copyright by control means. 



19. An image processing mcl".hod which comp^^^-^^^^' ^ 
a step of de1:ecting a digital watermark containad 

in image 6cit?i by detecting means; 

a step of obtaining an addi-ess of a device which 

liolcls a data l.ist relating to said image dai..a irom sai 

deteclied digital wai.e^-rmark inf or-ina i.ion by obtaining 

means ; 

a step of j;eceiving a data list from said device 
accQT-ding to said addi-csf^ by receiving means; and 

a s Lap o£ receiving data selected by a user froui 
said image data list by dai.a receiving moan^s . 
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AfiSTRACT OF THE DISCLOSURE 

The present invention provides an image proccss-lnq 
syst-Om wnich Ccsn make switch -over between ;:i oopy- 
pex-init.-Led state, and a copy-pr'ohiblted state 
5 autcmatioally acoox'ding to the type oi producLion while 
securely px'Ote^cting the yi-odiiotion , 

For the pxirposa, the system oa.uses a detoci-ing 
portion to detect the pr-esence of px-ede l:ermined 
information (I.e., production information) in image 

10 dat:a, when that image data yont. fx^om a user ."".-ide 
i.erminal to be output from an output device, if i.he 
T-esults of this dCl.ec:tion indiccite ±Lsi presence, thc.i 
system px'Ohibits outputting of that image dat'.a from the 
outpvit device. With this, the system x^eleases an 

15 output-prohibited stat.e of the above-tntmtioned image 
data based on the results of comparison betv^een a 
password sent from the usei* sTdc lar^minal and ci 
pa'ssword present in that image data. 
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FIG. 2 
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